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ABSTRACT 

The Career Awareness Program for Bilingual Haitian 
and Hispanic Students (CAP) in New York City was designed to provide 
these high school students of limited English proficiency with 
instruction in English as a Second Language (ESL) , native language 
arts (NLa) , and content area subjects taught bilingually. It also was 
intended to provide students with personal counseling, tutoring, and 
orientation to Americp.n edvication and culture. The design also 
included plans for parent outreach activities. The project enrolled 
365 students. Of these, 287 were Haitian and 32 spoke Spanish as 
primary language. For the most part, the project carried out 
activities proposed in its design. The project met its objectives for 
guidance and counseling, career conferences, £.nd staff development, 
but did not meet its objectives for ESL, NLA instruction in Haitian, 
and :;ttitude toward school. Objectives for staff awareness of pupil 
needs and problems and for parental involvement could not be 
evaluated due to lack of data. Recommendations are made for program 
improvement, especially in English language and NLA, and improved 
program evaluation. Appendixes discuss data collection and analysis 
and instructional materials. (oLD) 
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FOREWORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enroUment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Pro gram Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of piogramming mandated by Title VII regulations that do not have speciGcally 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainstreaming, referrals out Oi the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in A ppendix A following the text. 



Office of Research, Evaluation, and Assessment 
New York City Public Schools 

E.S.E.A. Title VII Evaluation Profile 

Career Awareness Program for Bilingual 
Haitian and Hispanic Students 
(Project CAP) 

Transitional Bilingual Education Grant T003A90330 

1991-92 

EXTRACT 

PROJECT DIRECTOR: Mrs. JoeUe Dufresne FUNDING CYCLE: Year 3 of 3 

SITES 

High Schools Borough G rade Levels Enrollment* 

(fall) (spring) 

Prospect Heights Brooklyn 9-12 134 113 

George W. Wingatc Brooktyn 9-12 162 159 

*llie project enrolled 365 students (3 less than in the previous year), 271 of whom participated both semesters. 
Male students numbered 153, female 187; gender was not provided for 25. Students served totaled 296 in the fall 
and 272 in the spring. 

STUDENT BACKGROUND 

Native Language Number of Students Countries of Origin Number of Students 

Haitian 287 Haiti 328 

French 43 Mexico 9 

Spanish 32 Dominican Republic 5 

Unreported 3 Honduras 3 

Other 4 

Unreported 15 

Median Years of Education in Native Countr y: 8.0; in the United States: 3.0 

Percentage of Students Eligible for Free Lunch Program: 89.0 



ADMISSION CRITERIA 

The project admitted students who scored at or below the 40th percentile on the Language Assessment 
Battery (LAB) and received the recommendation of the project's counselor. The project also considered teacher 
referrals and parent requests. 

PROGRAMMING 

Design Features 

Project CAP was designed to provide Haitian- and Spanish-speaking students of limited English 
proficiency (LEP) with instruction in English as a Second Language (E.S.L.), Native Language Arts (N.L.A), and 
content area subjects taught bilingually. It also was to provide students with personal counseling, tutoring, and 
orientation to American education and culture. The design also included plans for parent outreach activities. 
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Strengths and Limitations 



For the most pari, Project CAP carried out those activities it had proposed io its design. Participating 
students received instruction in E.S.L. and N.LA. and bilingual instruction in ihe content areas. Project CAP 
provided personal counseling, tutoring, and an orientation to American education and culture. 

CONCLUSIONS AND RECOMMENDATIONS 

As in the previous year, the project met its objectives for guidance and counseling, career conferences, and 
staff development and failed to meet objectives for E.S.L., N.LA. in Haitian, and attitude toward school. A 
greater percentage of students showed gains on the LAB and passed N.LA. courses in the current than in the 
previous year. Last year the project met its attendance objective at Prospect Heights High School only; this year il 
met it at both sites. ^Fhe project met its objective for curriculum development. As in the previous year, OREA 
was unable to evaluate objectives for staff awareness of pupil needs and problems, and for parental involvement. 
Whereas last year the project did not meet the Spanish N.LA. objective in either semester, this year it was 
successful in meeting it in the fall. Last year the project met its objective for field tnps; this year it partially met it. 
Last year the project met the content area objective only in science and social studies n the spring; this year it met 
the objective at Prospect Heights High School for mathematics both semesters, science in the fall, and social 
studies in the spring. Last year Project CAP did not meet its dropout prevention objective; this year it did. 
Similarly, while last year OREA was unable to evaluate the cultural heritage objective, the project was successful 
in meeting it this yt ar. The project appointed a new director for the 1992-93 year and plans to meet those 
objectives it had either failed to meet or only partially met. 

The conclusions, based on the findings of this evaluation, lead to the following recommendations: 

• Explore ways of increasing proficiency in English language skills, possibly by initiating peer tutoring or 
providing additional after-school remediation and computer-assisted instruction. 

• Attempt to increase passing rates in N.LA. and content area courses by increasing the use of a variety 
of techniques such a^ small group and individual instruction and peer tutoring, as well as by offering 
more materials to accommodate students' different learning styles. 

• Coordinate field trips with the availability of transportation. 

• Encourage the development of a positive change in student attitude toward school, possibly by having 
guidance counselors initiate group seSv^ions to this end. 

• Provide the datj required to fully evaluate all program objectives. 
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PROGRAM ASSESSMENT 



STAFFING 



Title VII Staff (Total 5) 



Title 


Degree 


Laneuace Competencies 


Title VII Fundine 


Project Director 


MA. 


French, Spanish, Haitian 


Full time 


Teacher Coordinator 


B.S. 


French, Haitian 


Full time 


Educational Assistant 


H.S. 


French, Haitian 


Full time 


Program Coordinator 


B.A. 


Haitian 


Full time 


Program Paraprofessional 


B.A. 


Haitian 


Full time 



Other Staff Working With Project Students (Total 25) 

Title Degree Certification 



Language Competencies and Teaching/ 
Communicative Proficiencies* 



Teacher 


21 


M.A. 


10 


Mathematics 


4 


Haitian 


TP 8 


Paraprofessional 


4 


M.S. 


7 


Bil. See. Stds. 


1 


Spanish 


TP6 


Guidance Counselor 


1 


B.S. 


3 


Social Stds. 


3 


French 


TP7 






B.A. 


2 


E.S.L. 


7 


Russian 


TP ! 






A.A. 


2 


French 


3 


German 


TP 1, CP 1 






High School 


2 


Speech 
Bus. Ed. 
Science 


1 

1 
1 


Italian 


CP I 



The project did not provide information on the qualifications of the guidance counselor. 

IMPLEMF.NTAIIQN AND OUTCOMES (Objectives prefaced by •) 
F.nulish as a Second Language (E.S.L.) 

E.S.L. CLASSES 



George Win^ate High School 
Periods Weekly Students Enrolled 



Prospect Heights High School 
Periods Weekly Students Enrolled 



Literacy 

Beginning 

Intermediate 

Advanced 

Transitional 



10 

10 

5 
5 
5 



15 
60 
35 
35 
5 



2 
2 
1 
2 
2 



70 
35 
35 
35 



E.S.L . instructors used computers and small groups to facilitate classroom lessons. Tutoring was provided 
by assistant teachers during scheduled periods as well as after school. For a list of instructional materials, see 
Appendix B. 



Tcachmg Proficiency (TP); Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 
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• Seventy percent of target students will demonstrate an appropriate increase in English language 
proficiency as indicated by significant improvement. 

Evaluation Instrument: Language Assessment Battery (LAB)* 

Pretest: May 1991; posttest: May 1992. 

Number of students for whom pre- and posttest data were reported: 246 

Percent of students with pretest/posttest gains: jl.2 

Mean gain: 5.3 N.CE.s (s.d.=9.2) 

Mean gain is statistically significant (/=9.0Q, p<.05). 

Although the mean gain on the LAB was substantial as well as being statistically significant, only 51.2 
percent of the students showed an appropriate increase in English proficiency as measured by a pretest/posttest 
gain on the LAB. 

Project did not meet objective for E.S.L* 



Native Language Arts fN.L.A.) 

Students demonstrating lack of native language literacy skills (estimated): 90 percent. 

N.L.A. CLASSES 



Hiuh School 


Level 


Periods Weeklv 


Language 


Enrollment 


Cicorgc Wingatc 


Beginning 


20 


French 


20 




Intermediate 


15 


French 


15 




Advanced 


15 


French 


25 




Advanced Placement 15 


French 


25 


Prospect Heights 


Literacy 


10 


Haitian 


70 




Beginning 


10 


French 


35 




Intermediate 


10 


French 


35 




Advanced 


5 


French 


35 



Only George W. Wingate High School offered Spanish N.L.A. The project did not provide information on 
the levels at which it was taught or on enrollment in those classes. 

Teachers of N.L.A. implemented various instructional strategies, including dramatization of the subject 
matter, group learning, peer tutoring, individualized instruction, and hands-on activities. In addition, small group 
tutoring by the project coordinator or paraprofessional was available to students. For a list of instructional 
materials, see Appendix B. 



OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was normcd. 
Test scores are reported in Normal Curve Equivalents (N.CE.s), which are normalized standard scores with a 
mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in N.CE.s in the 
absence of supplementary instruction and that participating students* gains are attributable to project services. 
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• Seventy-five percent of the Haitian Creole dominant participants will demonstrate a significant 
increase in Haitian Creole language achievement as indicated by significant improvement. 



• Seventy-five percent of the Spanish dominant participants will demonstrate a significant increase in 
Spanish language achievement as indicated by significant improvement. 

Evaluation Instrument: final course grades. 

PASSING GRADES IN NATIVE LANGUAGE ARTS 



Enrollment 



Language 

Haitian 
French 
Spanish 



Percent Passing 



Fall 

220 
19 
17 



Spring 

183 
7 
17 



Fall 

72.3 
68.4 
88.2 



Spring 

72.1 
71.4 
64.7 



Only in the fall in Spanish N.L.A. did over 75 percent of the students receive passing grades. 
Project partially met NXA, objective. 



Content Area Subjects 

Project CAP students took courses in mathematics, science, and social studies with a bilingual instructional 
approach. Content area subjects were taught five periods per week. The project used peer tutoring as an 
instructional strategy. Computer assistance was available in science, and paraprofessionals gave one-to-one 
assistance in the content areas as needed. For a list of instructional materials, see Appendix B. 

• At least seventy pcicent of all targeted students will score at or above the passing criterion of 65 in 
the content areas of social studies, mathematics, and science. 

Evaluation Indicator: final course grades. 

PASSING GRADES IN CONTENT AREAS 



Fall Spring 

High School Subject Enrollment Percent Passing Enrollment Percent Passing 



George W. Wingate Mathematics 147 42.9 137 45.3 

Science 75 48.0 44 65.9 

Social Science 137 54.7 139 50.4 

Prospect Heights Mathematics 129 75.5 99 78.8 

Science 101 63.4 80 70.0 

Social Studies 112 69.6 88 63.6 



The project met this objective only at Prospect Heights High School in mathematics both semesters, 
science in the spring, and social studies in the fall. 

Project partially met content area subjects objective. 
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Attendance 



The bilingual guidance counselor interviewed program students who showed poor attendance to determine 
the cause and to discuss possible solutions. Targeted students were referred to dropout prevention programs such 
as the N.Y.U, Stay-in-School Partnership, 

• Ajs a result of participating in the program, students' attendance will be significantly higher than that 
of mainstream students. 

Evaluation Indicator: student records. 

ATTENDANCE RATES 

Hi eh School Project Students Mainstream Students Difference 

George W. Wingate 91.2 80.8 10.4* 

Prospect Heights 95.4 74.9 20.5 * 

V<-05 

Project met the attendance objective. 

Last year, the attendance rate of participating students was 76.6 percent at George W. Wingate High 
School and 88.9 percent at Prospect Heights High School. Both schools showed an improvement in the current 
yea>;. 

Dropout Prevention 

• Program students will have a significantly lower dropout rate than similar non-program students. 
Evaluation Indicator: student records. 

DROPOUT RATES 

High School Project Students Mainstream Students 

George W. Wingate 0.0 4.0 

Prospect Heights 0.7 73 

*p<.05 

Project met the dropout prevention objective. 

Curriculum Development 

• By the third project year the curriculum specialist will have developed or translated one subject matter 
oriented instructional unit for teaching E.S.L., science, and social studies. 

Evaluation Indicator: project records. 

Instructional units were adopted and implemented from the Curriculum of the Central Programs Unit of 
Title VII. These units included science, social studies, mathematics, E.S.L., and N.L.A. 

Project met the curricutum development objective. 



Difference 

4.0* 
6.6* 
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Cultural Heritage 



• Seventy-five percent of all target students will demonstrate an improvement in attitude toward cultural 
heritage. 

Fivaluation Indicator: attendance at one or more cultural event, activity, or trip. 

All project students at Prospect Heights and George Wingate celebrated Haitian Flag Day, performed 
native Latino dances at an assembly, and visited the United Nations. 

Project met the cultural heritage objective. 

Attitude Toward School 

• Seventy-five percent of all target students will demonstrate an improvement in attitude toward school. 

Hvaluation Instrument: OREA-developed 5-point Likert scale to measure interest in continuing education beyond 
the llih grade. 

Data were available for 211 students. Of those, 65.9 indicated an improvement in altitude toward school. 
Project did not meet the objective for Improved attitude toward school. 

I-^icld Trip s 

• The program will organize at least two field trips for the targeted students at the two high school sites 
to historical museums and the United Nations, White House etc., to increase their familiarity with 
American culture and citizenship. 

Hvaluation Indicator: program records. 

At Prospect Heights High School, students visited the Brooklyn Museum and ihe Brooklyn Public Library, 
where they obtained their own library cards. At George Wingate High School, the students visited the United 
Nations. Other trips were scheduled but had to be canceled because dates on which transportation could be 
arranged were unavailable. 

Project partially met field trips objective. 

Guidance and Counselin g 

• All graduating students ^/ill meet with the bilingual career specialists/bilingual guidance counselor for 
advisement at least three times during the school year. 

Fivaluation Indicator: program records. 

The bilingual counselor met with all graduating students three times during the school year. In addition, 
the counselor reviewed ti.e records of graduating students to ensure that they had met all requirements for 
graduation and scheduled follow-up interviews. 

Project met guidance and counseling objective. 
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Career Conferences 

• The program will organize at least one conference for students in which representatives of business 
and industry will present information on career options and skill requirements. 

Evaluation Indicator: program records. 

The program participated in a Career Week event organized by the school. During this week, 
professionals came to speak to students about career opportunities and requirements. 

Project met career conference objective. 



F.nrollment in Post-secondary Institutions 

Thirty-eight of the 71 graduating students (53J percent) rej>orted an interest in enrolling in post-secondary 
institutions. 



Students With Special Academic Needs 

Referral to special education. If students were viewed as requiring special education services, they were 
referred to the School-based Support Team (S.B.S.T.) for interviewing and testing. While no member of the 
S.B.S.T. spoke Haitian, someone who spoke the language was available to assist in the evaluation. In the current 
year, no students were referred to special education programs. In the previous year, two students were referred. 

Remedial programs. As in the previous year, no students were referred to remedial programs. 

Gifted and talented programs. As in the previous year, no students were referred to programs for the 
gifted and talented. 



Mainstreaming 

Project CAP mainstreamed one student (0.3 percent of participants). In the previous year, the project had 
mainslreamed seven students (1.9 percent of participants). 

Academic achievement of former project students in mainstream . The project did not provide information 
on the academic achievement of formerly-served now mainstreamed students. 

S taff Development 

^ Fifty percent of program staff will enroll in at least one university course each semester. 

Hvaluation Indicator: program records 

Four of the five Title Vll-funded staff (80 percent) enrolled in college courses in the fall and spring 
semesters. 

Project met staff development objective for enrollment in college courses. 

1*. 
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• Eighty percent of the staff in the program will demonstrate an increase in awareness of pupil needs 
and problems. 

Evaluation Instrument: OREA-developed 5-point Likert scale of pupil needs and problems. 
The project did not submit the questionnaires to OREA. 

OREA was unable to evaluate stafT development objective for awareness of pupil needs and problems. 

Parental Involvement 

• The proportion of program parents who participate in Open School Day/Evening will be equal lo or 
greater than the proportion of mainstream students parents who participate in this activity. 

Evaluation Indicator: program and school activity records. 

'^The program organized a Parent Advisory Council (PAC), which met once a month. The program also 
organized Parent-Teacher Association (P.T.A.) meetings for parents of participating students. Prospect Heights 
High School provided E.S.L. and basic mathematics classes for parents of project students at both sites. Twenty- 
five parents enrolled, and 20 actively attended two times a week. The courses began in January and ran through 
June. 

TTie project director was unable to provide Open School Day/Evening attendance rates for project or 
mainstream parents. 

OREA was unable to evaluate parental involvement objective. 

CASE HISTORY 

The project did not provide a case history. 
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APPENDIX A 



DATA COLLECnON AND ANALYSIS 

COLLECTION 

OREA evaluation coDsuliants visit sites and interview key personnel. The project director ga:hers data 
and, with the consultant, completes forms (as shown below) as necessary. 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstreamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and exit from the 
program. 

Project Director s Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program implementation, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the questionnaire. 

Citywide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s). N.C.E.s are 
normalized standard scores with a meau of 50 and a standard deviation (s.d.) of 2L06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.s is the same 
whether it is at the lower or the higher end of the scale. N.C.E.S can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Type Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops v-^ud other 
activities. 



ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of insiruction, and gains made by project students could be attributed to project services. Scores are 
reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 2L06. (See "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a /- 
test. To test whether a difference between two proportions (e.g., program and mainstream attendance rates) is 



greater than could be expected by chance, OREA uses a 2-test and reports the differences between the two 
proportions. The level of significance is set at .05 for all tests. 

Techniques For Mimmizin£ Error 

The evaluation procedures minimize error by providing for proper administration of evaluation 
instruments through a combination of testing at 12-month intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above), the Degrees of Reading Power (D.R.P.) test, 
the Metropolitan Achievement Test-Mathematics (MAT-Math), El Examen de Lectura en Espanol (ELE), 
Likert-type scales (see above), and project-developed tests. Except for Likert scales and project-developed tests, 
these instruments are scored on a citywide basis at the Scan Center of the New York City Public Schools. 
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APPENDIX B 



INSTRUCTIONAL MATERIALS 

E.S.L. 

English, Step by Step With Pictures by Ralph Briggs and Robert J. Dixon, published by Prentice Hall. 
E.S.L. in the Content Areas by High School Bilingual/E.S.L Programs, published by the New York City Public 
Schools. 

Graded Kxpenences in English by Robert J. Dixon, published by Prentice Hall. 
N.LA. 

\fap LiAk Ke Kontan III and IV by F.I.C, published by Henri Dechamps. 
.Inn Apran Otograf Kreyol La by Iv DeJean, published by K,A, P.A.B. 

Mathematics 

Presnip De Bae Nan Matematik by Title VII, published by the New York City Public Schools. 
Achieving Competence in Math by Mathew Mandery, published by Amsco. 

Science 

American History by In/ing L. Gordon, published by Amsco. 
A frica by Laurence Palline, published by Globe Book Co. 



